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0160113. 
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CORRELATION WINDOW FOR OPEN-LOOP PITCH," Attorney Docket Number: 
01 60115. 

15 United States Patent Application Serial Number , 

"RECOVERING AN ERASED VOICE FRAME WITH TIME WARPING," Attorney 
Docket Number: 01 60116. 



BACKGROUND OF THE INVENTION 
20 1. FIELD OF THE INVENTION 

The present invention relates generally to speech coding and, more particularly, 
to noise suppression 



2. RELATED ART 
25 Generally, a speech signal can be band-limited to about 10 kHz without 
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affecting its perception. However, in telecommunications, the speech signal 
bandwidth is usually limited much more severely. For instance, the telephone 
network limits the bandwidth of the speech signal to a band of between 300 Hz to 
3400 Hz, which is known in the art as the "narrowband". Such band-limitation results 
5 in the characteristic sound of telephone speech. Both the lower limit of 300 Hz and 
the upper limit of 3400 Hz affect the speech quality. 

In most digital speech coders, the speech signal is sampled at 8 kHz, resulting 
in a maximum signal bandwidth of 4 kHz. In practice, however, the signal is usually 
band-limited to about 3600 Hz at the high-end. At the low-end, the cut-off frequency 

10 is usually between 50 Hz and 200 Hz. The narrowband speech signal, which requires 
a sampling frequency of 8 kb/s, provides a speech quality referred to as toll quality. 
Although this toll quality is sufficient for telephone communications, for emerging 
applications such as teleconferencing, multimedia services and high-definition 
television, an improved quality is necessary. 

15 The communications quality can be improved for such applications by 

increasing the bandwidth. For example, by increasing the sampling frequency to 16 
kHz, a wider bandwidth, ranging from 50 Hz to about 7000 Hz can be accommodated. 
This wider bandwidth is referred to in the art as the "wideband". Extending the lower 
frequency range to 50 Hz increases naturalness, presence and comfort. At the other 

20 end of the spectrum, extending the higher frequency range to 7000 Hz increases 
intelligibility and makes it easier to differentiate between fricative sounds. 

Background noise is usually a quasi-steady signal superimposed upon the 
voiced speech. For instance, assuming Figure 1 represents the spectrum of an input 
speech signal and Figure 2 represents a typical background noise spectrum. The goal 

25 of noise suppression systems is to reduce or suppress the background noise energy 
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from the input speech. 

To suppress the background noise, prior art systems divide the input speech 
spectrum into several segments (or channels). Each channel is then processed 
separately by estimating the signal-to-noise ratio (SNR) for that channel and applying 
5 appropriate gains to reduce the noise. For instance, if SNR is low, then the noise 
component in the segment is high and a gain much less than one is applied to reduce 
the magnitude of the noise. On the other hand, when SNR is high, then the noise 
component is insignificant and a gain closer to one is applied. 

The problem with prior art noise suppression systems is that they are 

10 computationally cumbersome because they require complex fast Fourier transforms 
(FFT) and inverse FFT (IFFT). These FFT transformations are needed so that the 
signal can be manipulated in the frequency domain. In addition, some form of 
smoothing is required between frames to prevent discontinuities. Thus prior art 
approaches involve algorithms that is sometimes too complex for real-time 

15 applications. 

The present invention provides a computationally simple noise suppression 
system applicable to real-time/real life applications. 
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SUMMARY OF THE INVENTION 
In accordance with the purpose of the present invention as described herein, 
there is provided systems and methods for suppression of noise from an input speech 
signal. The noise, in the form of background noise, is suppressed by reducing the 
5 energy of the relatively noisy frequency components of the input signal. To 
accomplish this, one embodiment of the invention employs a special digital filtering 
model to reduce the background noise by simply filtering the noisy input signal. With 
this model, both the spectrum of the noisy input signal and the one of the pure 
background noise are represented by LPC (Linear Predictive Coding) filters in the 
10 z-domain, which can be obtained by simply performing LPC analysis. 

In one or more embodiments, the shape of the noise spectrum is adequately 
represented with a simple first order LPC filter. Noise suppression occurs by applying 
a process that determines when the spectrum tilt of the noisy speech is close to the 
spectrum tilt of the background noise model so that only the spectrum valley areas of 
15 the noisy speech signal is reduced. And when the spectrum tilt of the noisy speech 
signal is not close to (e.g. less than) the spectrum tilt of the background noise model, 
an inverse filter of the noise model is used to decrease the energy of the noise 
component. 

These and other aspects of the present invention will become apparent with 
20 further reference to the drawings and specification, which follow. It is intended that 
all such additional systems, methods, features and advantages be included within this 
description, be within the scope of the present invention, and be protected by the 
accompanying claims. 
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BRIEF DESCRIPTION OF DRAWINGS 
Figure 1 represents the spectrum of an input speech signal. 
Figure 2 represents a typical background noise spectrum. 
Figure 3 is a block diagram illustrating the main features of the noise 
5 suppression algorithm. 

Figure 4 is a high-level process flowchart of the noise suppression algorithm. 
Figure 5 is an illustration of controlling noise suppression processing using 
spectrum tilt of each sub-frame. 



5 
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DETAILED DESCRIPTION 
The present application may be described herein in terms of functional block 
components and various processing steps. It should be appreciated that such 
functional blocks may be realized by any number of hardware components and/or 
5 software components configured to perform the specified functions. For example, the 
present application may employ various integrated circuit components, e.g., memory 
elements, digital signal processing elements, transmitters, receivers, tone detectors, 
tone generators, logic elements, and the like, which may carry out a variety of 
functions under the control of one or more microprocessors or other control devices. 

10 Further, it should be noted that the present application may employ any number of 
conventional techniques for data transmission, signaling, signal processing and 
conditioning, tone generation and detection and the like. Such general techniques that 
may be known to those skilled in the art are not described in detail herein. 

Figure 1 is an illustration of the frequency domain of a sample speech signal . 

15 The spectrum of speech signal represented in this illustration may be in the wideband, 
which extends from slightly above 0.0 Hz to around 8.0 kHz for a speech signal 
sampled at 16 kHz. The spectrum may also be in the narrowband. Thus, it should be 
understood by those of skill in the art that the speech signal in this illustration may be 
applicable to any desired speech band. 

20 Figure 2 represents a typical background noise spectrum in the input speech of 

Figure 1. As illustrated, in most cases the background noise has no obvious formant 
(i.e. frequency peaks), for example, peaks 101 and 102 of Figure 1, and gradually 
decays from low frequency to high frequency. Embodiments of the present invention 
provide simple algorithms for suppression (i.e. removal) of background noise from the 

25 input speech without the computational expense of performing Fast Fourier 
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Transformations. 

In an embodiment of the present invention, background noise is suppressed by 
reducing the energy of the relatively noisy frequency components. To accomplish 
this, the spectrum of the noisy input signal is represented using an LPC (Linear 
5 Predictive Coding) model in the z-domain as Fs(z). The LPC model is obtained by 
simply performing LPC analysis. 

Because of the shape of the noise spectrum, e.g. Figure 2, it is usually adequate 
to represent the noise spectrum, Fn(z), with a simple first order LPC filter. Thus, in 
one embodiment, when the spectrum tilt of the noisy speech is close to the spectrum 
10 tilt of the background noise model, only the spectrum valley areas of the Fs(z) (i.e. 
noisy components of the speech signal in the frequency -domain) needs to be reduced. 
However, when the spectrum tilt of the noisy speech is not close to (e.g. less than) the 
spectrum tilt of the background noise model, then an inverse filter of the Fn(z) model, 
e.g., 1/Fn(z), may be used to decrease the energy of the noise component. Because 
15 Fs(z) and Fn(z) are usually poles filters, 1/Fs(z) and 1/Fn(z) become zeros filters. 

Thus, when the input signal contains speech, one embodiment of the invention 
filters the noisy speech using the following combined filter: 

g . [l/Fn(z/a)] . Fs(z/b)/Fs(z/c) 

20 where the parameters a (0<=a<l), b (0<b<l), and c (0<c<l) are adaptive 

coefficients for bandwidth expansion; and g is an adaptive gain to maintain signal 
energy. The parameters a, b, c, and g are controlled by the noise-to-signal ratio 
(NSR). NSR is used instead of the traditional SNR (Signal-to-noise ratio) because it 
provides known bounds (0-1) that can easily be applied. 

25 And when the signal is determined to be pure background, i.e., no speech 
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content, an embodiment of the present invention only reduces the signal energy. 

An implementation of the noise suppression in accordance with an embodiment 

of the present invention is presented in the code listed in the appendix. Figure 3 is a 

block diagram illustrating the main features of the noise suppression algorithm. 
5 As illustrated, an input speech 301 is processed through LPC analysis 304 to 

obtain the LPC model (e.g. parameters). Normally, the noisy signal has been divided 

into frames and processed to determine its speech content and other characteristics. 

Thus, Input speech 301 will usually be a frame of several samples. The frame is 

processed in block 302 to determine filter tilt. Input speech 301 is then filtered by the 
10 noise suppression filters using the LPC parameters and tilt. An adaptive gain is 

computed based on the input speech 301 and the filtered output, which is used to 

control the energy of the noise suppressed speech 311 output. 

The above process is further illustrated in Figure 4, which is a high-level 

process flowchart of the noise suppression algorithm presented in the appendix. As 
15 illustrated, a frame of the noisy speech is obtained in block 402. In block 404, an LPC 

analysis is performed to generate the linear prediction coefficients for the frame. 

Each frame is divided into sub-frames, which are analyzed in sequence. For 

instance, in block 406 the first sub-frame is selected for analysis. In block 408, the 

noise filter parameters, e.g., spectrum tilt and bandwidth expansion factor, are 
20 computed for the selected sub-frame and, in block 410, interpolation is performed to 

smooth parameters from the previous sub-frame. The spectrum tilt and bandwidth 

expansion factor modify the LP coefficients based on the noise-to-signal ratio of the 

signal in the sub-frame. 

The spectrum tilt controls the type of processing performed on that sub-frame 
25 as illustrated in Figure 5. As illustrated, the spectrum tilt for each sub-frame is 
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computed in block 502. A determination is made in block 504 whether the spectrum 
tilt is equivalent to that of a pure background noise. If it is, then only the energy 
components of the input speech in the spectral valley areas is reduced in block 506, 
for example, by making b » c in block 306 (see Figure 3) . 
5 If on the other hand, the spectrum tilt of the sub-frame is not that of 

background noise, the inverse filter is applied using the combined filter function 
previously described on block 508. 

Referring back to Figure 4, the sub-frame is filtered through three filters 
l/Fn(z/a), Fs(z/b), and Fs(z/c) in block 412 (the combined filter). The filter l/Fn(z/a) 

10 could be simply a first order inverse filter representing the noise spectrum. The other 
two filters are an all-zero and an all-pole filter of a desired order. 

Finally, the adaptive gain (e.g. g) is computed in block 414 and applied to the 
filtered sub-frame to generate the noise filtered sub-frame. The gain can make the 
output energy significantly lower than the input energy when NSR is close to 1; if 

15 NSR is near zero, the gain maintains the output energy to be almost the same as the 
input. The remaining sub-frames are processed after a determination in block 416 
whether there are additional sub-frames to process. If there are, processing proceeds 
to block 418 to select a new frame and then returns back to block 408 to begin the 
filtering process for the selected sub-frame. This process continues until all sub- 

20 frames are processed and then processing exits at block 420 to await a new input 
frame. 

Although the above embodiments of the present application are described with 
reference to wideband speech signals, the present invention is equally applicable to 
narrowband speech signals. 
25 The methods and systems presented above may reside in software, hardware, or 
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firmware on the device, which can be implemented on a microprocessor, digital signal 
processor, application specific IC, or field programmable gate array ("FPGA"), or any 
combination thereof, without departing from the spirit of the invention. Furthermore, 
the present invention may be embodied in other specific forms without departing from 
5 its spirit or essential characteristics. The described embodiments are to be considered 
in all respects only as illustrative and not restrictive. 



10 
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APPENDIX 



/* 



:*/ 

•*/ 
*/ 
•*/ 

:*/ 



/* PURPOSE : 



Noise Suppression Algorithm 



/*. 

/*: 



10 



15 



20 



25 



30 



35 



40 



45 



/* Includes */ 

#include "typedef.h" 
#include "main.h" 
#include "ext_var.h" 
#include "gputil.h" 
#include "mcutil.h" 
#include "libjlt.h" 
#include "libjpc.h" 

/*=========================================================*/ 

/* */ 

/* STRUCTURE DEFINITION FOR SIMPLE NOISE SUPPRESSOR */ 

/* */ 
/*=========================================================*/ 

typedef struct 
{ 

INT16 count frm; /* frame counter from VAD */ 

INT16 Vad; /* Voice Activity Detector (VAD) */ 
FLOAT64 floor_min; /* minimum noise floor */ 

FLOAT64 r0_nois; /* strongly smoothed energy for noise */ 

FLOAT64 rl_nois; I* strongly smoothed tilt for noise */ 

FLOAT64 rlsm; /* smoothed tilt */ 

} SNSPARAM; 

/*=================== ===== ====== ========== == ============= */ 

/* FUNCTIONS */ 

/*============================================*/ 

void Init_ns(INT16 I frm); 

void BandExpanVec(FLOAT64 *bwe_vec, INT16 Ord, FLOAT64 alfa); 
void Simple_NS(FLOAT64 *sig, INT16 ljrm, SNS PARAM *sns); 



/* */ 

/* Constants */ 

/* - */ 

#define FS 8000. /* sampling rate in Hz */ 
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#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 



DELAY 24 /* NS delay : LPC look ahead */ 

SUBFO 40 /* subframe size for NS */ 

NP 10 /* LPC order*/ 

CTRL 0.75 /* 0<=CTRL<=1 0 : no NS; 1 : max NS */ 

EPSI 0.000001 /* avoid zero division */ 
GAMMA 1 0.85 /* Fixed BWE coeff. for poles filter */ 

GAMMA0 (GAMMA 1-CTRL*0.4) /* Min BWE coeff. for zeros filter */ 
TILT C (3*(G AMM A 1 -G AMMA0) *G AMMA 1 ) /* Tilt filter coeff. */ 



10 



/*_ 

/* 
/*. 



Constants depending on frame size 



-*/ 
*/ 
-*/ 



15 



20 



25 



30 



35 



40 



45 



static INT16 FRM; /* 

static INT16 SUBF[4]; /* 

static INT16 SF_N; /* 

static INT16 LKAD; /* 

static INT16 LPC; /* 

static INT16 L MEM; /* 



input frame size */ 
subframe size for NS */ 
number of subframes for NS */ 
NS delay : LPC look ahead */ 
LPC window length */ 
LPC window memory size */ 



/*____. 
/* 

/*._._. 

static 
static 
static 
static 
static 
static 
static 
static 
static 
static 
static 
static 



/*- 

/* 

/*- 



global tables, variables, or vectors 



FLOAT64 *window; /* 

FLOAT64 bwe_fac[NP+l]; /* 

FLO AT64 bwe_vecl [NP] ; /* 

FLOAT64 *sig_mem; /* 

FLO AT64 ref l_old [NP] ; /* 

FLOAT64 zero_mem[NP]; /* 

FLOAT64pole_mem[NP]; /* 

FLOAT64 zlmem; /* 

FLOAT64 gainsm; /* 

FLOAT64 tl_sm; /* 

FLOAT64 gamma0_sm; /* 

FLOAT64 age; /* 



-*/ 
*/ 
-*/ 



LPC window */ 
BW expansion vector for autocorr. */ 
BW expansion vector for poles filter */ 
past signal memory */ 
past reflection coefficient */ 
zeros filter memory */ 
poles filter memory */ 
tilt filter memory */ 
smoothed gain */ 
smoothed tilt filter coefficient */ 
smoothed zero filter coefficient */ 
adaptive gain control */ 



bandwidth expansion weights 



-*/ 
*/ 
-*/ 



50 



void BandExpanVec(FLOAT64 *bwe_vec, INT16 Ord, FLOAT64 alfa) 

INT16 i; 
FLOAT64 w; 

w= 1.0; 

for (i=0;i<Ord;i++) { 
w *= alfa; 
bwe_vec[i]=w; 
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} 

/* */ 

return; 

/* */ 

} 



10 



15 



/* */ 

/* Initialization */ 

/* */ 

void Init ns(INT16 I frm) 
{ 

INT16 i, 1; 
FLOAT64 x, y; 

/* */ 



FRM = l_frm; 
SFN = FRM/SUBFO; 
20 for (i=0;i<SF_N-l;i++) SUBF[i]=SUBF0; 
SUBF[SF_N-1]=FRM-(SF_N-1)*SUBF0; 
LKAD = DELAY* 

LPC = MIN(MAX(2.5*FRM, 160), 240); 
L_MEM = LPC - FRM; 

25 

/* */ 



window = dvector(0, LPC-1); 
1 = LPC-(LKAD+SUBF[SF_N-l]/2); 
30 for (i = 0; i < 1; i++) 

window[i] = 0.54 - 0.46 * cos(i*PI/(FLOAT64)l); 
for(i = l;i<LPC;i++) 
window[i] = cos((i-l)*PI*0.47/(FLOAT64)(LPC-l)); 

35 bwe_fac[0] = 1.0002; 
x = 2.0*PI*60.0/FS; 
for (i=l; i<NP+l; i++){ 

y = -0.5*SQR(x*(double)i); 
bwe_fac[i] = exp(y); 
40 } 

BandExpanVec(bwe_vecl, NP, GAMMA 1); 

/* */ 



45 sig_mem = dvector(0, L_MEM-1); 

ini_dvector(sig_mem, 0, L_MEM-1, 0.0); 

ini_dvector(refl_old, 0, NP-1, 0.0); 
ini_dvector(zero_mem, 0, NP-1, 0.0); 
50 ini_dvector(pole_mem, 0, NP-1, 0.0); 
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zlmem = 0; 

/* */ 

5 gain_sm=1.0; 
tl_sm = 0.0; 

gamma0_sm = GAMMA1; 
age = 1.0; 



10 /*- */ 

return; 

/* */ 

} 

15 /* */ 

/* parameters control */ 

/* */ 

void param_ctrl (SNS PARAM *sns, FLOAT64 engO, FLOAT64 *G, 
20 FLOAT64 *T1, FLOAT64 bwe v0[]) 

{ 

FLOAT64 C, gammaO; 
FLOAT64 nsr, nsr g, nsrdB; 

25 /* */ 

/* NSR */ 
/* */ 



if (sns->Vad==0) { 
30 nsr =1.0; 

nsr_g=1.0; 
nsrdB = 1.0; 

sns->rl_sm = sns->rl nois; 
} 

35 else { 

nsr = sns->r0_nois/sqrt(MAX(eng0, 1.0)); 

nsr_g = (nsr-0.02)*1.35; 
nsr_g = MIN(MAX(nsr_g, 0.0), 1.0); 
40 nsr_g = SQR(nsr_g); 

nsr_dB=20.0*loglO(MAX(nsr, EPSI)) + 8; 
nsr_dB=(nsr_dB+26.0)/26.0; 
nsr_dB=MIN(MAX(nsr dB, 0.0), 1.0); 
45 } 

if ( sns->r0_nois < sns->floor_min ) { 
nsrg = 0; 
nsr =0.0; 
50 nsr_dB = 0.0; 
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} 

/*— - - — * 

/* Gain control *, 
5 /* * 

*G= 1.0-CTRL*nsr_g; 

gain_sm = 0.5*gain_sm + 0.5*(*G); 

*G = gainsm; 

10 

/* * 

/* Tilt filter control * 

/* * 

15 C = TILT_C*nsr*SQR(sns->rl_nois); 
if (sns->rl_nois>0) C = -C; 
C += sns->rl_sm - sns->rl_nois; 
C *= nsr_dB*CTRL; 
C = MIN(MAX(C, -0.75), 0.25); 

20 

tlsm = 0.5*tl_sm + 0.5*C; 
*T1 = tl_sm; 

25 /* Zeros filter control *, 

/* *, 

gammaO = nsr_dB*GAMMA0 + (l-nsr_dB)*GAMMAl ; 
gammaOsm = 0.5*gamma0_sm + 0.5*gamma0; 
30 BandExpanVec(bwe_vO, NP, gammaO sm); 



return; 



35 } 

/*==========================================================*/ 

/* FUNCTION : Simple_NS (). */ 

/* */ 

40 /* PURPOSE : Very Simple Noise Suppressor */ 

/*-- */ 

/* INPUT ARGUMENTS : */ 

/* */ 

/* _ (FLOAT64 []) sig : input and output speech segment */ 

45 /* _ (INT16) lfrm : input speech segment size */ 

/* _ (SNS_PARAM) sns : structure for global variables */ 

/* OUTPUT ARGUMENTS : */ 

/* _ (FLOAT64 []) sig : input and output speech segment */ 

50 /* */ 
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/* RETURN ARGUMENTS : _ None. 
/*========================== 



*/ 
=*/ 



10 



15 



20 



25 



30 



35 



void Simple_NS(FLOAT64 *sig, INT16 l_frm, SNS PARAM *sns) 

FLOAT64 *sig_buff ; 
FLOAT64 R[NP+1], pderr; 
FLOAT64 refl[NP], pdcf[NP]; 
FLOAT64 tmpmem[NP+l], pdcf_k[NP]; 

FLOAT64 gain, tiltl, bwe_vec0[NP]; 
FLOAT64 C, g, engO, engl; 
INT16 i, k, i_s, l_sf; 

/* */ 

/* Initialization */ 

/* */ 

if (sns->count_frm<=l) 
Initns(lfrm); 

sig_buff = dvector(0, LPC-1); 

/* */ 

/* LPC analysis */ 

/* */ 

cpy_dvector(sig_mem, sigbuff, 0, L_MEM-1); 
cpy_dvector(sig, sig_buff+L_MEM, 0, FRM-1); 
cpy_dvector(sig_buff+FRM, sig_mem, 0, LMEM-l); 
cpy_dvector(sig_buff+LPC-LKAD-FRM, sig, 0, FRM-1); 

muldvector (sig buff, window, sig buff, 0, LPC-1); 
LPC_autocorrelation (sig_buff, LPC, R, (INT16)(NP+1)); 
mul dvector (R, bwe_fac, R, 0, NP); 
R[0] = MAX(R[0], 1.0); 

LPC levinson durbin (NP, R, pdcf, refl, &pderr); 

if (sns->Vad==0) { 
for (i=0; i<NP; i++) 
refl[i] = 0.75*refl_old[i] + 0.25*refl[i]; 



/* 
/*. 



Interpolation and Filtering 



.*/ 
*/ 
■*/ 



i_s=0; 

for (k=0;k<SF_N;k++) { 
l_sf=SUBF[k]; 
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/* Interpolation */ 

C = (k+1.0)/(FLOAT64)SF_N; 
if (k<SFN-l || sns->Vad==0) { 
5 for (i=0; i<NP; i++) 

tmpmem[i] = C*refl[i] + (l-C)*refl_old[i]; 
LPC_ktop(tmpmem, pdcfjc, NP); 

else { 

10 cpy_dvector(pdcf, pdcf_k, 0, NP-1); 

/* */ 

15 dot_dvector(sig+i_s, sig+i_s, &eng0, 0, l_sf-l); 

param_ctrl (sns, (eng0/l_sf), &gain, &tiltl, bwe_vec0); 

/* Filtering */ 

20 dot_dvector(sig+i_s, sig+i_s, &eng0, 0, l_sf-l); 

tmpmem[0]=1.0; 

mul_dvector (pdcfjc, bwe_vec0, tmpmem+1, 0, NP-1); 
FLTfilterAZ (tmpmem, sig+i_s, sig+i_s, zero_mem, NP, l_sf ) ; 



25 



tmpmem[l]=tiltl; 

FLT_filterAZ (tmpmem, sig+i_s, sig+i_s, &zl_mem, 1, l_sf); 



mul_dvector (pdcf_k, bwe_vecl, tmpmem, 0, NP-1); 
30 FLTfilterAP (tmpmem, sig+i_s, sig+i_s, pole_mem, NP, l_sf); 

/* - gain control */ 

dot_dvector(sig+i_s, sig+i_s, &engl, 0, l sf-1) ; 
g = gain * sqrt(eng0/MAX(engl, 1.)); 

35 

for (i = 0; i < 1 sf; i++) 
{ 

age = 0.9*agc + 0.1 *g; 
sig[i+i_s] *= age; 
40 } 

/* */ 

i_s += l_sf; 
45 } 

/* */ 

/* memory update */ 

/* */ 

50 cpy_dvector(refl, refl_old, 0, NP-1) ; 
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/* */ 

free_dvector(sig_buff, 0, LPC-1); 

5 /* */ 

return; 

I* */ 

} 
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